Bayesian Variable Selection and Regularisation for Time- Frequency Surface Estimation

نویسندگان

  • Patrick J. Wolfe
  • Simon J. Godsill
  • Wee-Jing Ng
چکیده

Here we describe novel Bayesian models for time-frequency analysis of nonstationary data. These models are based on the idea of a Gabor regression, in which a time series is represented as a superposition of time-frequency shifted versions of a simple window function whose essential support is well-localised in time and frequency. Specifically, we consider the case in which the set of potential predictors constitutes a frame rather than satisfying the more restrictive condition of a basis. Importantly, a key result in time-frequency theory (the Balian-Low Theorem) implies that in general, redundancy is a necessary consequence of good time-frequency localisation. Hence, in an inverse modelling context, the resultant models require careful regularisation through appropriate choices of variable selection schemes and prior distributions. Here, after constructing Bayesian models and prior distributions capable of taking into account the typical time-frequency characteristics of representative time series, we apply Markov chain Monte Carlo methods in order to sample from the resultant posterior distribution of interest. We provide examples using two of the most distinctive time-frequency surfaces—speech and music signals—as well as an EEG trace.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Hierarchical Bayesian-kalman Models for Regularisation and Ard in Sequential Learning

In this paper, we show that a hierarchical Bayesian modelling approach to sequential learning leads to many interesting attributes such as regularisation and automatic relevance determination. We identify three inference levels within this hierarchy, namely model selection, parameter estimation and noise estimation. In environments where data arrives sequentially, techniques such as cross-valid...

متن کامل

Regularisation in Sequential Learning Algorithms

In this paper, we discuss regularisation in online/sequential learning algorithms. In environments where data arrives sequentially, techniques such as cross-validation to achieve regularisation or model selection are not possible. Further, bootstrapping to determine a confidence level is not practical. To surmount these problems, a minimum variance estimation approach that makes use of the exte...

متن کامل

Bayesian variable selection and regularization for time–frequency surface estimation

We describe novel Bayesian models for time–frequency inverse modelling of nonstationary signals. These models are based on the idea of a Gabor regression, in which a time series is represented as a superposition of translated, modulated versions of a window function exhibiting good time–frequency concentration. As a necessary consequence, the resultant set of potential predictors is in general ...

متن کامل

A Note on Evolutionary Rate Estimation in Bayesian Evolutionary Analysis: Focus on Pathogens

Bayesian evolutionary analysis provide a statistically sound and flexible framework for estimation of evolutionary parameters. In this method, posterior estimates of evolutionary rate (μ) are derived by combining evolutionary information in the data with researcher’s prior knowledge about the true value of μ. Nucleotide sequence samples of fast evolving pathogens that are taken at d...

متن کامل

Gene Selection in Cancer Classification using Sparse Logistic Regression with Bayesian Regularisation

Motivation: Gene selection algorithms for cancer classification, based on the expression of a small number of biomarker genes, have been the subject of considerable research in recent years. Shevade and Keerthi (2003) propose a gene selection algorithm based on sparse logistic regression (SLogReg) incorporating a Laplace prior to promote sparsity in the model parameters, and provide a simple bu...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2004